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TITLE 

A System and a Method for High Speed Three-Dimensional Imaging 

RELATED APPLICATIONS 

[0001] The present application claims priority under 35 U.S.C. § 1 19(e) from the 
following previously-filed Provisional Patent Application, U.S. Application No. 60/431,61 1, 
filed December 5, 2002 by Geng, entitled "Methods and Apparatuses for High Speed Three 
Dimensional Imaging" which is incorporated herein by reference in its entirety. 

BACKGROUND 

[0002] High-speed three-dimensional (3D) imaging is an increasingly important 
function in advanced sensors in both military and civilian applications. For example, high- 
speed 3D capabilities offer many military systems with greatly increased capabilities in target 
detection, identification, classification, tracking, and kill determination. As a further 
example, real time 3D imaging techniques also have great potential in commercial 
applications, ranging from 3D television, virtual reality, 3D modeling and simulation, Internet 
applications, industrial inspection, vehicle navigation, robotics and tele-operation, to medical 
imaging, dental measurement, as well as apparel and footwear industries, just to name a few. 

[0003] A three dimensional surface profile imaging method and apparatus 
described in U.S. Pat. No. 5,675,407 ("the '407 patent"), the disclosure of which is 
incorporated herein by reference in its entirety, conducts imaging by projecting light through 
a linear variable wavelength filter (LVWF), thereby projecting light having a known, spatially 
distributed wavelength spectrum on the objects being imaged. The LVWF is a rectangular 
optical glass plate coated with a color-filtering film that gradually varies in color, (i.e., 
wavelength). If the color spectrum of a LVWF is within the visible light region, one edge of 
the filter rectangle may correspond to the shortest visible wavelength (i.e. blue or violet) 
while the opposite edge may correspond to the longest visible wavelength, (i.e. red). The 
wavelength of light passing through the coated color-filtering layer is linearly proportional to 
the distance between the position on the filter glass where the light passes and the blue or red 
edge. Consequently, the color of the light is directly related to the angle 0, shown in Figure 1, 
at which the light leaves the rainbow projector and LVWF. 
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[0004] Referring to Figures 1 and 2 in more detail, the imaging method and 
apparatus is based on the triangulation principle and the relationship between a light projector 
(100) that projects through the LVWF (101), a camera (102), and the object or scene being 
imaged (104). As shown in Figure 1, a triangle is uniquely defined by the angles theta (9) and 
alpha (a), and the length of the baseline (B). With known values for 0, a, and B, the distance 
(i.e., the range R) between the camera (102) and a point Q on the object's surface can be 
easily calculated. Because the baseline B is predetermined by the relative positions of the 
light projector (100) and the camera (102), and the value of a can be calculated from the 
camera's geometry, the key to the triangulation method is to determine the projection angle, 6, 
from an image captured by the camera (102) and more particularly to determine all 0 angles 
corresponding to all the visible points on an object's surface in order to obtain a full-frame 3D 
image in one snapshot. 

[0005] Figure 2 is a more detailed version of Figure 1 and illustrates the manner in 
which all visible points on the object's surface (104) are obtained via the triangulation 
method. As can be seen in the figure, the light projector (100) generates a fan beam of light 
(200). The fan beam (200) is broad spectrum light (i.e., white light), which passes through 
the LVWF (101) to illuminate one or more three-dimensional objects (104) in the scene with 
a pattern of light rays possessing a rainbow-like spectrum distribution. The fan beam of light 
(200) is composed of multiple vertical planes of light (202), or "light sheets", each plane 
having a given projection angle and wavelength. Because of the fixed geometric relationship 
among the light source (100), the lens of the camera (102), and the LVWF (101), there exists 
a one-to-one correspondence between the projection angle (0) of the vertical plane of light 
and the wavelength (X) of the light ray. Note that although the wavelength variations are 
shown in Figure 2 to occur from side to side across the object (104) being imaged, it will be 
understood by those skilled in the art that the variations in wavelength could also be made 
from top to bottom across the object (104) or scene being imaged. 

[0006] The light reflected from the object (104) surface is then detected by the 
camera (102). If a visible spectrum range LVWF (400-700 nm) is used, the color detected by 
the camera pixels is determined by the proportion of its primary color Red, Green, and Blue 
components (RGB). The color spectrum of each pixel has a one-to-one correspondence with 
the projection angle (0) of the plane of light due to the fixed geometry of the camera (102) 
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lens and the LVWF (101) characteristics. Therefore, the color of light received by the camera 
(102) can be used to determine the angle 9 at which that light left the light projector (100) 
through the LVWF (101). 

[0007] As described above, the angle a is determined by the physical relationship 
between the camera (102) and the coordinates of each pixel on the camera's imaging plane. 
The baseline B between the camera's (102) focal point and the center of the cylindrical lens of 
the light projector (100) is fixed and known. Given the value for angles a and 9, together 
with the known baseline length B, all necessary information is provided to easily determine 
the full frame of three-dimensional range values (x,y,z) for any and every visible spot on the 
surface of the objects (104) seen by the camera (102). 

[0008] While the camera (102) illustrated in Figure 2 effectively produces full 
frame three-dimensional range values for any and every visible spot on the surface of an 
object (104), the camera (102) also requires a high Signal-to-noise (S/N) ratio, a color sensor, 
and an LVWF (101) with precision spectral variation, all of which is expensive to achieve. 
Consequently, there is a need in the art for an inexpensive yet high speed three dimensional 
camera. 

SUMMARY 

[0009] A high speed 3D camera includes a monochromatic sensor configured to 
receive a reflected light pattern from an object to be photographed, a plurality of optical 
pattern filters configured to capture multiple separate sequential images of the object using 
the reflected light pattern, and a computing device configured to combine the sequential 
images to generate a single frame image of the object, wherein the single frame image 
provides sufficient information to generate 3D image of the object. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] The accompanying drawings illustrate various embodiments of the present 
system and method and are a part of the specification. The illustrated embodiments are 
merely examples and do not limit the scope of the claims. 

[0011] Fig. 1 is a simplified block diagram illustrating a triangulation principle 
used in the present system and method according to one exemplary embodiment. 
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[0012] Fig. 2 is a block diagram illustrating a number of components traditionally 
used in a Rainbow 3D camera according to one exemplary embodiment. 

[0013] Fig. 3 is a simplified diagram illustrating a monochromatic camera 
receiving three variable intensity patterns according to one exemplary embodiment. 

[0014] Fig. 4A is a simplified block diagram illustrating a 3D camera 
incorporating a sequential within frame time (SWIFT) concept according to one exemplary 
embodiment. 

[0015] Fig. 4B is a chart illustrating a timing of the projection and exposure 
trigger of the 3D camera illustrated in Fig. 4A according to one exemplary embodiment. 

[0016] Fig. 5 A is a simplified block diagram illustrating a 3D camera 
incorporating a SWIFT concept according to one exemplary embodiment. 

[0017] Fig. 5B is a chart illustrating a timing of the projection and exposure 
trigger of the 3D camera illustrated in Fig. 5A according to one exemplary embodiment. 

[0018] Fig. 6 is an exploded view illustrating monochromatic pattern projection 
using an LED array according to one exemplary embodiment. 

[0019] Fig. 7 is a simplified block diagram illustrating a system configured to 
acquire 3D images in real time using near infrared light according to one exemplary 
embodiment. 

[0020] Fig. 8 is a side view illustrating the positioning of a high speed 
electronically controllable shutter according to one exemplary embodiment. 

[0021] Fig. 9 A is a simplified block diagram illustrating the acquisition of a 2D 
color image using a monochromatic sensor according to one exemplary embodiment. 

[0022] Fig. 9B is a simplified block diagram illustrating the acquisition of a 2D 
color image using a monochromatic sensor according to one exemplary embodiment. 

[0023] Fig. 10 is a simplified block diagram illustrating a system for acquiring a 
full coverage 3D image according to one exemplary embodiment. 

[0024] Throughout the drawings, identical reference numbers designate similar 
but not necessarily identical elements. 
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DETAILED DESCRIPTION 

[0025] The present specification discloses a method for performing high speed 
three dimensional imaging using a monochromatic sensor. More specifically, a camera 
configuration is disclosed having a monochromatic sensor that receives light patterns 
produced by a monochromatic light projector. A number of methods are disclosed for using 
the present camera configuration to produce, among other things, a red green blue (RGB) 
color image, a three dimensional image, multiple exposures in a single frame, and full 
coverage three-dimensional images. 

[0026] As used in the present specification and in the appended claims, the phrase 
"CCD" or "charge-coupled device" is meant to be understood as any light-sensitive integrated 
circuit that stores and displays the data for an image in such a way that each pixel (picture 
element) in the image is converted into an electrical charge, the intensity of which is related 
to a color in the color spectrum. Additionally, the term "trigger" is meant to be understood as 
an event or period of time during which a projection or sensing event is performed. "Cross- 
talk" refers to any interference between projection patterns, whether projected from a single 
projector or multiple projectors. Additionally the term "Philips prism" is a term of art 
referring to an optical prism having tilted dichroic surfaces. Also, the term "monochromatic" 
refers to any electromagnetic radiation having a single wavelength. The term "Rainbow-type 
image" or "Rainbow-type camera" is meant to be understood as an image or a camera 
configured to collect an image that may be used to form a three-dimensional image according 
to the triangulation principles illustrated above with respect to Figures 1 and 2. 

[0027] In the following description, for purposes of explanation, numerous 
specific details are set forth in order to provide a thorough understanding of the present 
method and apparatus. It will be apparent, however, to one skilled in the art that the present 
method and apparatus may be practiced without these specific details. Reference in the 
specification to "one embodiment" or "an embodiment" means that a particular feature, 
structure, or characteristic described in connection with the embodiment is included in at least 
one embodiment. The appearance of the phrase "in one embodiment" in various places in the 
specification are not necessarily all referring to the same embodiment. 

[0028] Rainbow light traditionally used by the Rainbow 3D camera illustrated in 
Figure 2 is a beam of broad-spectrum light (i.e., white light) which passes through a LVWF 
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(101) to illuminate one or more three-dimensional objects (104) with a pattern of vertical 
planes of light (202); each plane having a given projection angle and wavelength. In order to 
collect the reflection of the rainbow projection from the object surface, a color CCD camera 
was traditionally used. The variation in the sensed spectrum was determined by the ratio of 
Red, Green, and Blue (RGB) components of each pixel in a color image acquired by the CCD 
camera. 

[0029] Rather than follow the traditional methods of using a relatively expensive 
RGB sensor to capture a color spectrum image, one exemplary embodiment illustrated in 
Figure 3 uses a monochromic CCD camera (300) having red, green, and blue filters to capture 
three separate images, one for each color, and integrate these three images into an RGB color 
image. Moreover, to further reduce the cost of the present system and method, a 
monochromatic light projector configured to transmit three variable intensity patterns similar 
to the spectral characteristics of the RGB filters of the present CCD camera is used. 

[0030] As shown in Figure 3, a camera (300) that implements the teachings of the 
rainbow 3D camera while using a monochromatic sensor receives three sequential light 
projections (310, 320, 330), each having a variable intensity pattern similar to the spectral 
characteristics of the RGB filter. Once the three sequential light pattern projections (310, 
320, 330) are received by the camera (300), they are transferred to a communicatively 
coupled computing device (340) or other pattern combination means configured to combine 
the three monochromatic images received by the camera (300) to obtain a one frame image 
that is equivalent to that of the above mentioned Rainbow projection. The computing device 
(340) may host an application such as a mosaic program configured to combine the three 
monochromatic images into a one frame image. 

[0031] By using the configuration of Figure 3, the costly CCD sensor and LVWF 
may be eliminated without sacrificing accuracy of the 3D images. More importantly, the 
configuration illustrated in Figure 3 facilitates a narrow-band projection and image 
acquisition for each sensor employed. Accordingly, simultaneous acquisition of multiple 3D 
images from different views using multiple monochromatic 3D sensors with different spectral 
wavelengths is possible as will be further described with reference to Figure 10 below. 

[0032] Figure 4A illustrates a 3D imaging system (400) configured to image a 
three-dimensional object (460) using a 3CCD sensor and monochromatic light produced by 
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three light emitting diodes (LEDs) (410). As shown in Figure 4 A, the imaging system (400) 
may include a projection portion including a plurality of light sources (410) such as LEDs, 
light projection patterns (420), and projection optics (430). The imaging system (400) also 
includes an imaging portion including imaging optics (440) and a 3CCD sensor (450). 

[0033] The plurality of light sources (410) illustrated in Figure 4A may include 3 
LEDs, each emitting different spectrum bands. LED technology has made rapid advances in 
recent years, partly fused by the demands from optical telecommunication industry. Recent 
development of high-brightness LED materials has opened a variety of rapidly growing 
applications for LEDs. Materials used in producing the LEDs of Figure 4A may include, but 
are in no way limited to, AlGaAs (red), InGaAlP (yellow-green through red), and inGaN 
(blue, green, and white). Similarly, the LEDs may include, but are in no way limited to, 
leaded or surface-mount package types. As projection light sources, LEDs have several 
distinguished advantages including: 1 . extremely high lighting efficiency (very low current 
draws (approx. 0.1 A) vs. several Amps for halogen lamps); 2. nanosecond level of switching 
speed: unlike halogen or metal halide lamps which have thermal warming up periods to reach 
steady status of light illumination, LEDs can switch on and off, and control brightness very 
rapidly (in the nanosecond level); 3. LEDs provides a narrow spectrum band (in the region of 
30 nanometer bandwidth versus traditional wideband white light projection); 4. Fast response 
time - nanoseconds vs. seconds for halogen lamps (by synchronizing with CCD/ 
Complementary Metal Oxide Semiconductor (CMOS) sensor acquisition timing, such fast- 
responded projection device can achieve very strong projections while making them virtually 
undetectable by subjects due to slow response time of the human eye); and 5. life span: 
100,000 hours versus the typical 1000 hours for halogen lamps. Additionally the timing of 
the LEDs for illumination can be easily coupled with high speed trigger signals in the 
corresponding sensor channels as will be discussed in further detail below with reference to 
Figure 4B. The light projection patterns (420) used in conjunction with the LEDs or other 
light sources (410) can use monochromic light and can be designed independently to 
maximize the light output. 

[0034] The projection optics (430) illustrated in Figure 4A may include any 
number of lenses, mirrors, or beam splitters commonly used in the art. Similarly, the imaging 
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optics illustrated in Figure 4A may include a number of lenses and mirrors commonly known 
in the art that may be used to focus a received image onto the 3CCD sensor (450). 

[0035] The 3 CCD sensor (450) illustrated in Figure 4A is a sensor including three 
charge-coupled devices (CCDs). A CCD is a light-sensitive integrated circuit that stores and 
displays the data for an image in such a way that each pixel (picture element) in a received 
image is converted into an electrical charge, the intensity of which is related to a color in the 
color spectrum. The CCD sensors (450) illustrated in Figure 4A may have a frame rate as 
high as 120 frames per second (fps) or higher, thereby facilitating the acquisition of images at 
a rate of 30 fps. While the embodiment illustrated in Figure 4A is described in the context of 
incorporating 3 CCD sensors, any number or type of light sensing sensors may be used. 
According to one exemplary embodiment, two sensors may be used to produce a three- 
dimensional image. 

[0036] During operation of the imaging system (400) illustrated in Figure 4 A the 
LEDs (410) sequentially project light sources, each having varying spectrum bands due to the 
light projection patterns (420). The light sources are projected by the projection optics (430) 
and reflected off of a three-dimensional object (460). Once reflected, the imaging optics 
(440) collect the reflected images which are then sensed by the 3 CCD sensor (450) to produce 
a three-dimensional image. The challenge of the sequential projection approach described 
above is the reduced imaging speed. By projecting three separate light projections, three 
separate image frames have to be taken in order to obtain a single frame 3D image. In order 
to increase imaging speed, three independent R, G, B frames are obtained within a single 
frame cycle (at normal video rate) using the 3 chip CCD sensors (450) as shown in Figure 4B. 
This method not only increases the imaging speed, but it also eliminates the effect of multi- 
frame crosstalk. 

[0037] Traditional 3-chip CCD sensors use a single "exposure trigger" signal line 
for all 3 CCD sensors. An exposure trigger is a period of time wherein a light projection is 
exposed to its corresponding sensor channel. Images with all three colors were traditionally 
taken during the same exposure period. This of course creates the possibility of crosstalk 
among these channels. Crosstalk occurs when multiple components of light exposure 
contribute to a single component channel. For example, the output of the Red channels will 
not only be contributed to by the red component of the light exposure, but also the "crosstalk" 
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from blue spectrum due to the spectrum sensitivity curve of the red sensor. The fundamental 
reason for the crosstalk is the fact that multiple channels of lighting pattern are shined to the 
sensor simultaneously. If these lighting patterns are projected in a sequential fashion within 
the same field cycle, the crosstalk problem can be resolved. 

[0038] Figure 4B illustrates an implementation of a sequential within frame time 
(SWIFT) concept according to one exemplary embodiment. As illustrated in Figure 4B, 
rather than using single exposure trigger timing, a plurality of timing trigger circuits are used 
to produce separate and independent exposure trigger signals (480, 482, 484) for red, green, 
and blue channels. These trigger signals TR (480), TG (482), and TB (484) are synchronized 
with their corresponding light source/structural pattern projections for Red (490), Green 
(492), and Blue (494) strobe channels. The trigger signals corresponding to sensor exposure 
(480, 482, 484) as well as the light source projections (490, 492, 494) can be overlapping or 
non-overlapping, depending on the tolerance of different channels for being affected by 
crosstalk. For example, if red (480) and green (482) channel have little crosstalk, they can be 
controlled to be exposed simultaneously. On the other hand, if red (482) and blue (484) have 
severe crosstalk, then their timing should be arranged sequentially to eliminate the possible 
crosstalk effect. 

[0039] More importantly, the duration of these trigger signals TR (480), TG (482), 
and TB (484) can be controlled independently to accommodate the CCD sensitivity, object 
reflectivity for different surface colors, and illumination source variations. The light 
source/structural pattern projections for red (490), green (492), and blue (494) channels will 
be controlled accordingly to synchronize with the exposures of their corresponding channels. 

[0040] By synchronizing the projection and exposure trigger signals as illustrated 
above, high image collection rates may be achieved. The above-mentioned synchronization 
methods facilitate three-dimensional imaging acquisition at typical video rates (30 frames per 
second). Additionally, the exposure time for each exposure trigger can be much shorter (e.g. 
1/2000 sec.) than the 1/30 of a second frame cycle (470) allowing all of the exposures for 
different channels to be performed within a single frame cycle (470). Moreover, because the 
projection and exposure trigger signals may be sequentially synchronized, crosstalk issues 
may be eliminated and the design of the multi-spectrum projection mechanism may be 
simplified. 
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[0041] In an alternative embodiment illustrated in Figure 5 A, high speed 3D 
surface imaging can be accomplished using the SWIFT method and a 3CCD sensor (560) in 
conjunction with a sequential color projector. As shown in Figure 5 A, The SWIFT 3CCD 
sensors (560) may be synchronized with a traditional video projector system to form a 3D 
imaging system (500). As shown in Figure 5 A, one exemplary embodiment of a high speed 
3D imaging system (500) for imaging a three-dimensional object (570) includes the 
traditional components of a video projector system such as a light source (510), projection 
optics (520), a deformable mirror or LCD (530), and a color wheel (540). These components 
are used to project onto the three-dimensional object (570) being imaged. The imaging 
portion of the 3D imaging system includes imaging optics (550) and a 3CCD sensor (560). 

[0042] As shown in Figure 5 A, a light source (510) produces light which is then 
transmitted through a number of projection optics (520) including lenses, mirrors, and/or a 
polarizing beam splitter. The light may then be sequentially varied using a deformable mirror 
or an RGB LCD (530) in connection with a color wheel (540) using traditional projector 
switching technology. According to one exemplary embodiment, the switching frequency of 
the traditional video projector is 30 frames per second (fps); however, projectors with other 
frequencies can also be used according to the same principles. While the various color 
projections are sequentially projected, they reflect off of a three-dimensional object (570) and 
are then received by the imaging optics (550). As the image projections are sequentially 
received by the imaging optics (550), they are sequentially sensed and collected by the 3CCD 
sensor (560). Once collected, the image projections may be used to produce a three- 
dimensional image according to the 3D imaging methods described above. 

[0043] Figure 5B illustrates a method for using the color generation mechanism of 
the video projector to perform sequential color projection within a single frame cycle time 
using the SWIFT concept. As shown in Figure 5B, the timing of the color generation (592) 
performed by the video projector may be synchronized with the timing of the SWIFT sensor 
exposure (586, 588, 590). The timing is synchronized to match the exposure of the red CCD 
(586) with the red projection, the exposure of the green sensor (588) to the green projection, 
and the exposure of the blue sensor (590) to the blue projection. By so synchronizing the 
color generation and the sensor exposure, crosstalk between different color channels can be 
eliminated and three clean frames of image with corresponding projection patterns can be 
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produced. These clean frames of image may then be used to generate both odd (594) and 
even (596) 3D images. 

[0044] In addition to the video projectors previously mentioned, an array of LEDs 
(610) can be economically built to produce narrow-band pattern projections (640, 650, 660) 
as illustrated in Figure 6. As shown in Figure 6, a 3D imaging system (600) may include an 
array of closely spaced RGB LEDs (610) formed in a video projector. The spacing of the 
LEDs (610) may vary depending on the desired projection patterns. The LEDs (610) are 
coupled to a number of electronic drivers (620) that selectively control the projection of 
narrow-band pattern projections (640, 650, 660), through projection optics (630) similar to 
those described above, and onto a three-dimensional object. By controlling the LED array 
(610) with the electronic drivers (620), the narrow-band pattern projections (640, 650, 660) 
can be suited to facilitate imaging according to the 3D imaging systems illustrated above. 
The driver electronics (620) may control and sequentially vary the intensity of each vertical 
column of LEDs. To that end, the driver electronics (620) can include a memory device that 
pre-stores several designed patterns and perform quick switches among them in the sequential 
projection operations. Once the narrow-band pattern projections (640, 650, 660) are reflected 
from the three-dimensional object, they may be sequentially received by imaging optics (550; 
Fig. 5) and sequentially sensed and collected by a 3CCD sensor (560; Fig. 5) according to the 
above-mentioned SWIFT concept. While the above illustrated example includes varying the 
intensity of each vertical column of LEDs, the controlled variation of the LEDs may occur on 
a horizontal row basis or any other desired pattern. 

[0045] The driver electronics (620) illustrated in Figure 6 may also synchronize 
the projection timing of the LEDs with any number of imaging sensors (CCDs or CMOSs) to 
achieve a desired optical performance. One of the issues in traditionally structured light 3D 
imaging systems is that they typically required high brightness to achieve acceptable 
accuracy. Bright lighting on human faces often affects the comfort level of the human 
subject. Using the fast response advantage of the LEDs, strong illumination can be projected 
in a very short amount of time, as short as 1/1000 of a second in one exemplary embodiment. 
This strong illumination can be synchronized with the timing of an imaging sensor to obtain 
an acceptable image according to the present SWIFT system and method. Moreover, the 
strong illumination in such a short period of time produced by the 3D imaging system (600) 
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illustrated in Figure 6 will not be felt by human subjects or cause any harm to the human 
subjects due to the slow response time of human eyes. 

[0046] While the use of the LED array (610) illustrated in Figure 6 allows for non- 
recognizable illumination in very short bursts, a number of uses desire an imaging system that 
can continuously acquire 3D images in real-time without projecting visible light onto the 
subject and without being affected by ambient visible illumination. Figure 7 illustrates an 
exemplary system that may be used to acquire 3D images in real-time without projecting 
visible light on the subject according to one exemplary embodiment. As shown in Figure 7, 
an exemplary 3D imaging system (700) is equipped with a near infrared (NIR) Rainbow light 
source (730) such as a halogen lamp with a long pass filter, a plurality of mirrors with a saw- 
tooth reflection pattern (710), Philips prisms (720), and other projection optics (740) 
including a polarizing beam splitter. Similarly, the imaging portion of the 3D imaging system 
(700) illustrated in Figure 7 includes imaging optics (750) such as lenses and Philips prisms 
as well as three NIR CCD sensors (760). Because identical Philips prisms may be used in 
both the sensors (760) and the light source optics, design and production costs of the NIR 3D 
imaging system (700) illustrated in Figure 7 are reduced. 

[0047] Using the configuration illustrated in Figure 7, matching spectrum bands 
between the 3CCD sensor (760) and the light source (730) is facilitated by the fact that both 
the projection and the imaging are performed using identical prisms. Additionally, any 
number of wavelengths from the NIR spectrum may be used, as long as three bands can be 
separated, and sawtooth intensities are generated by three identical "mirror gratings," with 1/3 
phase shift. 

[0048] In order to further facilitate the timing of the SWIFT and other 3D imaging 
systems described above, any of the 3D image acquisition systems may include a high speed 
shutter (820) optically coupled to the video projector (810) as shown in Figure 8. As shown 
in Figure 8, a high speed shutter (820) may be placed between a video projector (810) and a 
three-dimensional object that is to be imaged (840). As the video projector (810) illuminates 
the object that is to be imaged (840), the high speed shutter (820) controls the timing of the 
pattern projection. Both the ON/OFF timing and the transmission rate of the high speed 
shutter (820) are electronically controllable. Consequently, the high speed shutter (820) may 
be used both to control the light intensity of the illumination from the video projector (810) 
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and control the timing of the pattern projection to match the sensor trigger channels of the 
sensors disposed in the image sensor (830). 

[0049] According to one alternative embodiment, the above-mentioned 3D 
imaging systems may be used to acquire both two-dimensional color images and three- 
dimensional images using the same monochromatic sensor. As shown in Figure 9 A, a two- 
dimensional color image (970) may be acquired by projecting sequential red (912), blue 
(914), and green (916) projections from the projector (910). As each color projection (912, 
914, 916) is projected onto the object to be imaged (920), the single monochromatic sensor 
(930) acquires three sequential images (940, 950, 960), each corresponding to one of the 
sequential color projections (912, 914, 916). Once the three sequential images (940, 950, 
960) are acquired by the monochromatic sensor (930), the three sequential images are 
combined to form a full color 2D image (970). This acquisition of a full color 2D image may 
be used in conjunction with the 3D imaging methods discussed above. Additionally, while 
the above-mentioned method was illustrated using sequential red (912), blue (914), and green 
(916) projections, any other desired combinations of colors may similarly be projected onto 
the object to be imaged (920) and combined to form a single two-dimensional image. 

[0050] Similar to the embodiment illustrated in Figure 9A, a 2D color image may 
be acquired by associating a plurality of filters (932, 934, 936) with the monochromatic 
sensor (930). According to this exemplary embodiment, a projector (910) projects 
monochromatic light onto an object to be imaged (920). As the reflected image is received by 
the monochromatic image sensor (930), a color filter wheel or electronic color tunable filter 
having a plurality of filters (932, 934, 936) is placed in front of the monochromatic image 
sensor. As a desired object is illuminated, three sequential images are acquired using three 
different color filters (932, 934, 936) in front of the sensor. According to one exemplary 
embodiment, the three different filters (932, 934, 936) include a red filter, a green filter, and a 
blue filter configured to produce corresponding sequential images (940, 950, 960) that may 
then be combined to form a full color 2D image. Once the three sequential images are 
acquired, they may be used as the RGB (or other color) illuminations for the RGB channels of 
a full color image (970). Consequently, the above-mentioned systems and methods illustrated 
in Figures 9A and 9B may be used according to the SWIFT concept teachings above to 
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produce both a three-dimensional image and a full color two-dimensional image in a single 
frame. 

[0051] According to yet another alternative embodiment, the above mentioned 
methods and apparatuses may be used to acquire a full coverage 3D image of a desired object. 
In order to acquire a full coverage 3D image of a desired object, a "snapshot" instant 
acquisition of multiple images from different views must be performed. The primary 
challenge of implementing such a system is that the operations of multiple 3D cameras often 
interfere with one another. In other words, the projection patterns of one camera can often be 
seen and detected by a second camera (known as crosstalk). This crosstalk can seriously 
affect the 3D imaging functions of each camera. 

[0052] In order to remedy the potential crosstalk problems associated with full 
coverage of a 3D image using multiple cameras, a matched narrow-band spectral filter may be 
placed in front of each CCD sensor (1020) causing each 3D camera to function at a pre- 
designed wavelength range. As shown in Figure 10, a system (1000) is presented including 
multiple 3D cameras having sensors (1020) with different non-overlapping bandwidths 
positioned around an object to be imaged (1030). Each sensor (1020) may collect 3D data 
regarding the object to be imaged (1030) from different views using the above-mentioned 
high speed imaging methods. For example, once the object to be imaged (1030) is 
positioned, multiple light patterns may be simultaneously projected onto the object to be 
imaged and the sensor (1020) of each 3D camera may then simultaneously acquire images 
without interfering with each other. According to the teachings previously mentioned, each 
sensor (1020) may use a different bandwidth to eliminate crosstalk between images, similar to 
dense wavelength division multiplexing (DWDM). Once acquired, the images may then be 
routed to a computing device (1010) where they are compiled to form a full surface image. 

[0053] In conclusion, the present system and method for high speed three- 
dimensional imaging produces a three-dimensional image having the accuracy of a rainbow 
type image. Moreover, the three-dimensional image produced according to the present 
system and method is collected without the use of an expensive LVWF or a color sensor. 
Rather, the present system and method incorporates a monochromatic projector and a 
monochromatic sensor. Additionally, the present system and method facilitates the collection 
of the three-dimensional images by synchronizing the trigger signals, enabling image 
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collection at rates over 30 fps. High image collection rates may be further enhanced by 
utilizing an LED array configured to project light undetectable by a human subject. 

[0054] The above-mentioned system and method also allow for the collection of 
3D images using a NIR rainbow light source. This system will allow the collection of 
accurate 3D image data using a light source undetectable by a human subject. 

[0055] The preceding description has been presented only to illustrate and 
describe embodiments of invention. It is not intended to be exhaustive or to limit the 
invention to any precise form disclosed. Many modifications and variations are possible in 
light of the above teaching. It is intended that the scope of the invention be defined by the 
following claims. 
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